From the founding of political Zionism in the 1890s, Haredi Jewish leaders voiced objections to its secular orientation, and before the establishment of the State of Israel, the vast majority of Haredi Jews were opposed to Zionism. This was chiefly due to the concern that secular nationalism would redefine the Jewish nation from a religious community based in their alliance to God for whom adherence to religious laws were “the essence of the nation’s task, purpose, and right to exists,” to an ethnic group like any other as well as the view that it was forbidden for the Jews to re-constitute Jewish rule in the Land of Israel before the arrival of the Messiah. Those rabbis who did support Jewish resettlement in Palestine in the late 19th century had no intention to conquer Palestine and declare its independence from the rule of the Ottoman Turks, and some preferred that only observant Jews be allowed to settle there.

During the 1930s, some European Haredi leaders encouraged their followers not to leave for Palestine, where the Zionists were gaining influence. When the dangers facing European Jewry became clear, the Haredi Agudath Israel organization decided to co-operate with Zionist leaders to an extent, in order to allow religious Jews the possibility of seeking refuge in Palestine. Some Agudah members in Palestine preferred to form an alliance against the Zionist movement with Arab nationalists, but this never occurred. After the creation of the state of Israel, each individual movement within ultra-Orthodox Judaism charted its own path in their approach to the State of Israel.

Around 80% of European Haredim were murdered in the Holocaust. A study in late 2006 claimed that just over a third of Israelis considered Haredim to be the most hated group in Israel. According to a 2016 Pew survey, 33% of Israeli Haredim say that the term "Zionist" describes them accurately.